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I ! 

■ Abstract — Visual distortions of perceived lengths, angles, or forms, are generally known 
I as "geometric-optical illusions" (GOl). In the present paper we focus on a class of GOls 

^ ■ where the distortion of a straight line segment (the "target" stimulus) is induced by an 

O i array of non-intersecting curvilinear elements ("context" stimulus). Assuming local target- 

■ context interactions in a vector field representation of the context, we propose to model the 
perceptual distortion of the target as the solution to a minimization problem in the calculus 

■ of variations. We discuss properties of the solutions and reproduction of the respective form 
of the perceptual distortion for several types of contexts. Moreover, we draw a connection 
between the interactionist model of GOls and Riemannian geometry: the context stimulus is 

_ understood as perturbing the geometry of the visual field from which the illusory distortion 

■ naturally arises. The approach is illustrated by data from a psychophysical experiment with 
Q I nine subjects and six different contexts. 

_ Keywords: calculus of variations, geodesic, geometric-optical illusions, Hering type illu- 

' ■ sions, Riemannian geometry, vector field, visual perception 

1 Introduction 

> 

*^ I "Geometric-optical illusions" (GOl) is a covering term for a broad class of phenomena, where 

■ visual perception of lengths, angles, areas or forms in a figure (e. g. a simple line drawing) is 
^ , altered by other components of the figure. These phenomena demonstrate, generally, the de- 
pendence of a percept on its context, and allow to study the structural principles underlying the 
organization of visual percepts, or "laws of seeing" ll24l . Since their discovery 12611271 . GOls 
have been the subject of intensive experimental research (for comprehensive reviews see f7| 
and [29 1), but they are still far from being well understood. The variety of proposed explana- 
tions ranges from physiological theories, based on mutual interactions between elements of the 
neural substrate (e. g., retina or primary cortical areas) |l3l|6l|36l, to purely mentalist theories, 

i interpreting the GOls as results of "unconscious inferences" (15) or inappropriately applied cog- 

nitive strategies lfT4ll . However, no unitary theory of the GOls has been established until present 
days, and it is even doubtful whether such a unified explanatory theory is conceivable Q. 

In the present paper we study a well-defined class of GOls that are reducible to a com- 
mon generating principle. The emphasis is not on the human vision system or on psycho- 
logical factors, nor will physiological or psychological "mechanisms" be proposed; we aim 
at a representative-descriptive rather than explanatory-causal theory. Specifically, we focus 
on a class of GOls in which perception of a target element — usually a segment of a straight 
line — appears distorted when presented with an array of (curvi)linear elements, in the follow- 
ing called the context. An example for such target-context interactions first reported by Hering 
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Figure 1: Examples of geometric-optical illusions. Upper row: a) Classic form of Hering's fl61 illusion and b) its 
modification due to Thiery and Wundt |38|; c) Illusory bending of straight lines in a flat, non-perspectival context. 
Lower row: d,e) Distortions of square shape in two different contexts 1 11 , 28|; f) Trapezoid deformation of square 
shape similar to e) in a different context, obtained by permutation of quadrants of pattern d) I33J . 



lfT6l is the illusory curvature of straight lines over which an array of concurrent lines is su- 
perposed (Fig. la). Since then a great number of GOls have been constructed, discovered, or 
re-discovered on the same principle 138111711281 (Figs. lb,d,e). 

These phenomena — hereafter called illusions of "Hering type" — are of particular interest 
for several reasons. First, they depend on local interactions between the target and the context 
elements, as is evidenced by variant figures in which parts of the context pattern are deleted ll33l . 
Next, they demonstrably do not depend on a "scenic" impression induced by the context patterns 
(Fig. le,f). Finally, they all exhibit angular expansion at the target-context intersections: the 
illusory distortion of the target always acts to enlarge the acute angles at the intersection points 
(Fig. 1, passim). This effect, also dubbed "regression to right angles," seems to be constitutive 
for the class of GOls of our interest [4, 19 1 as well as in other types of GOls ||201|2T1 . 

These observations set up the framework for our modeling approach fW\. Starting with a 
minimal set of assumptions plus the fact that the straight line is the shortest path connecting 
two points, we propose a variational principle for the perception of a linear target, draw a 
connection to Riemannian geometry, and show that approximate solutions of the respective 
variational problem reproduce the perceptual distortions of the target (Sections |2]to|4ll. Further, 
we report on a related psycho-physical pilot experiment using six different context patterns 
(Section |5]). Finally, we discuss achievements and limitations of this work (Section [6l). 

The main text covers the basic approach along with the applied methods and the results. All 
mathematical details, derivations, and proofs are given in the Appendix. 
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2 Variational problem for Bering type illusions 

Our focus in this paper is on the case where the target is a straight line, and the context con- 
sists of a family of (generally curved) lines that intersect the target but not each other. We will 
conceive of the context lines as the stream lines of a planar flow given by a continuously differ- 
entiable vector field v defined on some region H C containing the target in its interior^ To 
any point ^ € H is attached a vector, v{^), indicating the "velocity" of the flow at the point ^. In 
view of the purely geometric character of the context it is natural to assume that \v{^,)\ = 1 for 
all ^ G H. Here \a\ = {a, a) and {a, b) = aibi + 0262 denote the Euclidean norm (length) and 
inner product, respectively, of vectors a,b £ R^. In geometrical terms, the normalized inner 
product (a, b) /|a| |6| gives the cosine of the angle between a and b, which we denote as Z(a, b). 

In graphical presentations of GOls only a finite sample of context curves is displayed. The 
complete set of context lines, which form a continuum in the plane, may then be conceived of 
as continuously interpolating the sample. The target is here assumed to be the straight line, r, 
connecting two given endpoints tq, ri € M^H In illusions of Hering type r is not perceived 
as a straight line: it appears slightly curved. The basic idea of our approach is to model the 
deviating percept as a perturbation of r that is characterized by a minimum principle. Setting 
up the principle involves three components: 

(a) the local interactions hypothesis: the context v "acts" only along candidate paths, in the 
vicinity of the target; 

(b) the angular expansion hypothesis ("regression to right angles"), based on the phenomenol- 
ogy of GOls (cf. Introduction); 

(c) the fact that the straight line is the shortest path between two points. 

Observing (b) and (c) we then posit the principle that, given the context vector field v, the 
straight line target r is distorted so that ( i) the stream lines ofv ( the context lines) are intersected 
"as orthogonally as possible ", and ( ii) the distorted line is as short as possible. 

This can be formulated mathematically as an optimization problem under side conditions. 
Since there is no a priori criterion suggesting length or orthogonality as the primary or the 
side condition, we propose to optimize a weighted mixture of the two terms. Specifically, we 
consider the following 

Variational problem [VP]: Given the vector field v, to, ti G M such that to < ^i. endpoints 
Tq, Ti £ M?, and some number a > 0, minimize the fiinctional 



over the set X of all twice continuously differentiable planar curves x = {x{t),t G [to,ti]} 
with given endpoints x(to) = ''"0 ^>^d x{ti) = ti such that x{t) G H and \x{t)\ > Ofor every t. 

'For clarity it has to be emphasized that the vector field v just serves us to represent the context; it is neither 
related to any kind of field theory or perceptive field, nor to the receptive field of the retina. Likewise, there is no 
supposition as to where the percept is located "materially." Finally, the term "flow" is used only metaphorically; it 
shall not convey any idea of motion. 

^Subscripts may index objects (such as tq, ti) as well as the components of a vector (such that y — (2/1,2/2) if 
1/ £ is a row vector). The appropriate interpretation will always be evident from the context. 
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In this setting, X comprises the possible candidates for the actual percept. The first term 
in ([T|l, f^^ \x{t)\dt = J^*^ represents the length of x. (The superscript dot denotes the 

derivative w. r. t. the parameter t.) The second term accounts for the context-target interaction: 
its integrand is essentially the square of the cosine of the angle subtended by v and the curve x at 
the point hence it measures the deflection from orthogonality along the curve. The division 
by \x{t) \ is to make the right-hand side of ([T]) invariant under reparameterizations of the "time" 
parameter so that it depends only on the trace of the curve x, and not on its parameterization. 
By its coordinate-free formulation, the problem is also invariant under translations and rotations. 
The number a > 0, finally, accounts for the strength of the illusory effect. Obviously, for a = 
only the length term is being minimized, and the solution of the problem reduces to the straight 
line between tq and ri, that is, to r. Since the actual percept deviates only slightly from the 
straight line target, one may anticipate that a should be small. 

Remark 1 The above minimum principle is distantly related to Fermat's principle, which char- 
acterizes the path of a light ray through an inhomogeneous medium. Indeed, on rewriting the 
functional (dJ in the form x i— )• f^^ F{x{t),x{t)) dt with integrand 

F{xit),±it)) = \x{t)\+a{±it),v{xit))f/\xit)\ 

= \x{t)\[l + a J, (2) 

one sees that the variational problem amounts to minimizing the functional x i— f^^ n(t) \ dx{t)\ 
where 

n{t) = I + a {x{t),v{x(t))f /\x{t)\'^ = 1 + acos^ Z{x{t),v{x{t))) 

is the "refraction index" — which in our case depends not only on the "medium" (here: the 
context) as traversed by the path, via v{x{t)), but also on the tangents to the path, x{t). 

3 Analysis of the variational problem 

Let us first introduce some notation. With any curve x ^ X we, associate another two curves 
p = px, p-*- = p^, called the Frenet 2-gon: for every t, p{t) = x{t) /\x{t)\ denotes the tangent 
direction vector; p^{t) denotes the unit (normal) vector obtained when rotating p{t) counter- 
clockwise by 90°, making {p{t), p^{t)} a positively oriented orthonormal basis of M^. Con- 
cerning the context, we write v'{£,) for the total derivative of v at the point ^ G H, which 
is a linear mapping from into itself; v'{^)* denotes its adjoint. In standard coordinates, 
v'{^) is given by the 2x2 matrix of partial derivatives of w at ^ ("Jacobian"), with entries 
djVkiOi ^ ^ {!) 2}, where quite generally, dj stands for the partial derivative w. r. t. the j-th 
argument. Finally, 

denotes the rotation of v at the point ^. For simplicity, we henceforth assume H = M^. 

functional of the form y J^^^ F{y{t),y{t)) dt is invariant under reparameterization if tlie integrand is 
1 -homogeneous in the sense that F{u, cv) = cF(u, v) for all c > and arguments u, v L8J. 
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3.1 Euler-Lagrange equation 



We apply the apparatus of the calculus of variations fSl. Generally, a curve x £ X at which 
a functional of the form x i— )• jj^^ F{x{t),x{t)) dt attains a minimum necessarily satisfies the 
Euler-Lagrange equation 

^ ViF{x{t),x{t)) - V,F{x{t),x{t)) = (for all t). (3) 

Here V^F, V^F denote the partial gradients of F with respect to the (vector) arguments x, x, 
respectively. In our special case where F is given by the Euler-Lagrange equation becomes 



(l — a(/9, f (x))^) p = —2a 



[v{x)-{p,v{x))p\ ^{p,v{x)) + {p,v{x)) {v'{x)-v'{x)*) X 



where for compactness of notation we omitted the parameter t. This system of two nonlin- 
ear, second-order differential equations reduces in fact to one single equation that concerns the 
"normal" component orthogonal to the solution curve. 

Proposition 1 For a < 1 the normal component of the Euler-Lagrange equation is given by 

±v _o I - I {vix),p^){p,v'ix)p) + {v{x),p)uj{x) 

^p,p ; za|X| ^2a{v{x),p^y ' ^ ' 

In the simplest special case of a constant vector field one would expect that the straight line 
r should result as the unique solution to (01). Indeed, since i;' = in this case, the right-hand 
side of (111) vanishes, which implies (p, p-*-) = 0, hence p = 0, meaning that the direction vector 
p does not change along x. Consequently, x is a straight line, and since its endpoints are fixed 
at those of r it follows that x = t. 



3.2 Connection with Riemannian geometry 

The very formulation of the variational problem VP and its resemblance to Fermat's principle 
(cf. Remark [T]) suggest to look for a strictly geometrical interpretation. Such an interpretation 
can indeed be given for a slight modification of VP. 

Intuitively, the medium, here represented by the context, perturbs the flat Euclidean geom- 
etry so that the shortest path between two points is curved rather than straight. Mathematically, 
such a non-Euclidean Riemannian geometry Il23l requires specifying a metric tensor G on some 
differentiable manifold by means of which the length of a parameterized curve x{t), to < t < ti 
in the manifold is, invariantly under reparameterization, expressed as 

Lg{x)= / .y{x{t),G{x{t))x{t))dt. (5) 
J to 

The metric tensor attaches to each point ^ of the manifold a positive definite symmetric matrix 
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that depends smoothly on ^. The usual Euclidean geometry corresponds to the special case 
G = I, the 2x2 identity matrix. A curve z is (a segment of) a geodesic (in the given geometry) 
if for any two to < ti the functional x — )• Lg{x) in ^ attains its minimum among all smooth 
curves x with the same endpoints z{tQ), z{ti) as z at the curve x = z. 

Here, the manifold will be identified with the drawing plane M^. The metric is, for given 
a > and vector field v, defined by 

G = G{i) = I + 2av{^)m{0 (eeM^), (6) 

with entries gjj = 1 + 2a f j(O^) 9jk = 2a Vj{£^) Vk{i) (j / k). The rationale for this choice is 
straightforward: the root of the quadratic form G{x{t)) x{t)) approximates the function 
F from Q to the first order in a. It may thus be expected that minimization of the criteria ([T]) 
and ([5]) should yield similar solutions. Precise statements are given in the next subsection. 

Hereafter we will refer to the problem of minimizing the functional Lq : A' — M as GP. In 
stating the following necessary condition, and further below, we shall use subscripts a whenever 
we want to emphasize that some quantity depends on the parameter a figuring in GP (or VP). 

Proposition 2 Let a > 0. A curve 7^ G ^ that is a solution to GP (i.e., a geodesic) satisfies 
the (Euler-Lagrange) equation 

X = -2a (^ta(x) p + na(x) p^^ , (7) 

where for general x £ X 

^a{x) = Y^2^ [{v{x),p){p,v'{x)p) -2a{v{x),pf {v{x),p^)uj{x)'^ , (8) 

na(x) = (^{vix),p^){p,v\x)p) + {v{x),p)u;ix){l + 2a{v{x),pf}y (9) 

The system (Q is split into its tangential and normal components by forming inner products 
with p and p^, respectively. In the latter case this gives after division by |x| (and noting that 

{x/\x\,p^) = (/), /9^)) the equation 

{p,p-^) = -2a \x\ na(x), 

which may be compared to (IDl: for small a, the right-hand sides of the two equations are almost 
the same. 

3.3 Approximate shape of the perceptual distortion 

The purpose of this subsection is to derive approximations to the geodesic 7q, which are then 
used to define what we call the shape of the perceptual distortion. That shape, denoted cr, is 
uniquely given by the target r and the vector field v\ in particular, knowing the parameter a is 
not required for determining a. Using the shape as the fundamental link, we then clarify the 
connection between the variational problems VP and GP. 



6 



An explicit expression for the geodesic 7q, (solution to (|7]l) generally is not available; how- 
ever, for small a it can be approximated by means of a rapidly converging iterative procedure. 
Given a > and x S we set 

x) = -2 (i^{x) p + na(x) p^) , (10) 

which considered as a function of t G [to, ti] represents a curve in M^. The following is essen- 
tially the Picard-Lindelof scheme for the iterative solution of an ordinary differential equation 
(system). Let a sequence of curves Xa,n € be defined as follows. One starts with Xafl = t, 
the target line, which we take to be parameterized as r(t) = tq + T^^ {t — to) (''"i — ^"o) , ^ = 
tl — to; for n = 1, 2, . . ., 

(t) = ba,n + a S )iu)du, (11) 

Jto 

(t) = To + / Xa,n+l{u)du. (12) 

The side condition Xa,n+i{ti) = ti, i-^- Xa,n+i G A^, is achieved by putting 

ba,n = T'^ (^Ti-TQ-a Sa{Xa,n, Xa,n){u) du dt^ . (13) 

Proposition 3 Suppose that the mapping ^ i— t- v{(,) is twice continuously differentiable in a 
neighborhood of the target r. Then there is a* £ (0, 1) and a constant C such that the following 
holds: for every < a < a* there exists a solution £ X to eq. (O such that 

- 7a||oo = SUPiy<(<(^ \Xa,n{t) - la{t)\ < Co^'^^ (n = 0, 1, 2, . . . ) . (14) 

This means that for each sufficiently small a the sequence Xa^n converges exponentially 
fast to a geodesic, 7q,. By ([T4l) . already the first iteration, Xa,i, equals 7q, up to terms of order 
O(a^), which will prove sufficiently accurate for our purposes. On the other hand, 7q, (or Xa^i) 
differs from r by terms of order 0{a), which suggests an ansatz 7a = r + aa wherein a 
would represent the limit as a — of the rescaled deflection (70, — r)/Q! of 7q, from r0 As 
such, a describes the approximative shape of this deflection. The scheme ([TTI) to (fT3l) suggests 
that a should be given by the conditions a = So{T,f) and (T(to) = (^(ti) = via a twofold 
integration, 

a{t)= / So{T,f){r)drds-T-\t-to) / So{T,f){r)drds. (15) 

J to J to J to J to 

For a more explicit description, note first that the 2-gon for the straight line r is constant along 
r. We denote the corresponding pair of orthonormal vectors as pQ, p^; thus po = (''"i — '^o)/^ 



*Thus far, a was a fixed parameter, assumed "small." In the following we conceive of a as an 'order parameter' 
indexing a. family of problems VP^, GPq, to be studied asymptotically as q — >■ 0. 
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with £ = \ti — tqI the length of r, and f = T ^ipo. Observing (ITOl ). ([8]l and Q one then finds 
that 

a = SoiT, f ) = -2 {e/T f (Fto(T) po + no(r) p^) (16) 
= -2(£/T)2(^[(^;(r),/,o>(po,^'(T)/>o>]/5o 

+ [ {v{r),Po){po,v'{T)po) + {v{t),po) uj{t)] p^ 

The approximation Xa = t + aa will represent our final guess ("prediction") for the (biased) 
percept of the target. Let us say that a certain curve 77 is the approximate shape of the deflections 
of a family of curves ya G A' (a > 0) from the target, or briefly, the shape (ofya), if | |ya — t — 
ar/l loo = 0{a^) as a —7- 0. For example, the shape of Xq, is a (trivially). 

Proposition 4 Under the conditions of Proposition\3\the following holds. 

\\la-Xa\\oo = 0{a^) (a^O). (17) 

Moreover, curves G A" (a > 0) with shape ij satisfy the Euler-Lagrange equation d?]) up to 
terms of the order 0{a^) a — )■ cH if and only if {rj, p^) = {a, pg). 

The first statement implies that the geodesies 7^ as well as the approximations Xa,n , n > I 
all share the same shape as Xa, namely a. (This follows from ([TT] ) and (fT4l) . which together 
give \\xa,n — XaWoo = 0(a^).) In particular, Xa approximates the solution 7q, to eq. ([T]) to 
the first order in a (i.e., up to terms of order 0{a^)). On the other hand, Xa also represents a 
first-order approximate solution to eq. ^ since it trivially satisfies the if-condition in the second 
statement. In fact, any first-order approximate solution to ^ necessarily has, to first order, the 
same lateral deflection from the target as Xa, in that the normal components of their respective 
shapes are identical. 

The important conclusion here is that the same curve, Xa, represents an approximate solu- 
tion, accurate up to terms of order 0{a'^), to both problems VP and GP simultaneously. Hence, 
the phenomenologically motivated and the geometrical approaches leading to the variational 
problems VP and GP, respectively, yield, to first order, identical predictions for the shape of the 
perceptual distortion. In that sense, the two approaches are equivalent. 

Remark 2 Since {xa, p^)/a = {a, p^) = -2{i/T)'^ no(r), by ([T6ll, the sign of 

"o(t) = {v{t),p^){pq,v'{t)pq) + {v{t),pq)uj{t) 

determines whether Xa, when travelled through from tq to ti, is bending to the left-hand side 
(sign no (r) = —1) or to the right-hand side (sign no (r) = +1), respectively. Therefore, the 
qualitative winding behavior of x^ can be read off already from that sign; knowing the shape a 
completely is not required for this purpose. 

'The observant reader will notice that we consider approximations at two different levels: the level of solution 
curves in case of problem GP (first satement), and the level of Euler-Lagrange equations in case of problem VP 
(second statement). The latter transition frees us from having to refer to 'solutions to eq. Q' the existence of which 
is unclear in case of problem VP (other than with GP). 
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Conveniently, a depends only on the known quantities v{t) and r, making Xa easily calcu- 
lable for any trial parameter a. This allows for a straightforward implementation of the method 
of compensatory measurement in our experimental study described in Section [5] 

4 Examples 

Here we introduce three families of context curves forming the streamlines of the vector field 
V. We represent such a family by means of a real-valued smooth function c(n, 6) depending 
on two real arguments u, 9 such that c is strictly increasing in 6 for each fixed u. The context 
curves u ^ Ce{u) = {u,c{u,6)) then do not intersect for different 6s, and we may assume 
that for every point = (^1,^2) in some region H C there exists 9 = i?(^i,C2) such 
that c{^i, £,2)) = £,2^ Within this setting, one can calculate the crucial quantities t^, via 
explicitly in terms of partial derivatives of c. 

Of particular interest is the behavior of the normal and tangential components, and ta, 
along the target. Suppose that r is the horizontal line segment between tq = {—i/2,0) and 
ri = {£/2, 0) {£ > 0), parameterized hy t = u = £1 e [-i/2, i/2]. Then for a = we have 

Mr) ^ no = [dlc{l-id,cf) + dl^c-id,cf/d2c]/[l + {dicf]\ (18) 
to(r) = no = -dic{dl,c-dj^c-dic/d2c) /[l + {dicf]\ (19) 

wherein the partial derivatives are evaluated at the arguments {^ij'&iCi, 0)). (Note that one has 
0)) = by the definition of {}, so the parameter 9 for which the curve Cg crosses 
the target at the point (^1, 0) is ^ = 0).) We only give the expressions for the primarily 
important quantity uq, which describes the lateral deflection of the percept from the target. 
The following three types of functions c will be considered. 

Type 1 (vertical shifts): c{u, 9) = q{u) + 9 for some given function q. Then 

dic = q\ O2C = 1, dliC = q" , 5^2^ = 
(primes here denote derivatives w. r. t. u), whence 

no = g"(l-g'')/(l + c?'')'. 

If q is even and convex then uq > at least in the central part of r, since g'(0) = 0. Thus in view 
of Remark [2l our principle predicts that the curve appears concave there (bending downward 
away from the origin. This fits with the perceived curvatures in Figs. 3a, 3b, 3d, as well as 
Fig. Id (lower edge) or Fig. Ic (upper line). Of course, by symmetry the converse holds if q is 
concave instead of convex; see Figs. 3c, 3e, 3f, Id (upper edge), Ic (lower line). 

Type 2 (dilation): c is of the form c(u, 9) = 9q{u) — a with a constant a > and a function q 
satisfying q{u) > g(0) > 0, < |u| < ^. Here 

dic = 9q' , 820 = q, dfiC = 9q" , 9^2^ = Q 
*For notational convenience coordinate vectors are written as row vectors. 
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Figure 2: a) Illustration of context-induced effects: Straight line target r (red line) embedded in a type 2 context 
(array of curves). The dashed line above r represents our prediction for the average observer's percept, the lower 
(dashed) line is counterbalanced so as to be perceived as straight by the average observer. See text for detailed 
explanation. — b) Comparison of various approximations. Shown are: (i) the prediction x^, and the first three 
iterations converging to the geodesic 7^ ; (ii) the analogous curves when the tangential component is ignored. See 
text. Note that up to scaling all curves share approximately the same form, namely that of the shape of the perceptual 
distortion, a. 



with 



6) = (a + ?2)/g(?i) (and .^i = n). Hence along r, where ^2 = or 9 = a/q, 
[ (1 - (aq'/qf) aq"/q + a' {q' /qf ] / [ 1 + {aq' /qf ] ' . 



no 



Again, no is positive (negative) near the origin if (/'(O) = and q is convex (concave) there- 
abouts. The conclusion in regard to the perceived curvature thus is the same as for type 1. 

Type 3 (segments of concentric circles): c(u, 9) = y/9'^ — v? — a, \u\ < 9 where a is a positive 
constant and 9 > a. The curves represent concentric upper half circles intersecting the x- 
axis at the points ztV^^ _ q,2_ Observing ^ = ^2) = + (a + ^2)^ one finds that for 
^2 = the numerator of no in (fTSl) equals the constant —1/a, and 

no = -a-i(l + (6/a)2)-'. 

In particular, no < 0, and the principle predicts that the perceived curve should be convex 
(bending upward away from the origin), in agreement with, e.g.. Figs. Id, If, upper edge. 

It should be noted that the conclusions regarding curvature are similar for the various context 
types. This suggests a simple rule of thumb: the percept tends to be bent in the opposite direction 
as the context curves. See e.g. Fig. 2a, 2b, where the curvatures of the pattern and the shape a 
differ between the center and the margins, in opposite ways. 

Let us discuss this example in more detail. The context in Fig. 2a is of type 2, with q{u) = 
1 + sin^(7rn), \u\ < 1/2, a = 0.239, and twelve 9's equally spaced between 0.1 and 0.3. The 
two lines above and below the target r are determined as x± = r it aa, respectively, where a is 
the shape computed numerically via ([Ts] ). ([T6l ) using ([TSl l. ([T9l ): and a = 0.05 is the average a 
value (across trials and participants) obtained in the experiment described in Section[5l Note that 
the target appears slightly bent upward in the middle, and this effect is roughly doubled when 
x+, which is our prediction for the average observer's percept, is drawn within the same context. 
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Conversely, subtracting the distortion as in removes the perceived curvature for the average 
observer!^ This 'compensation principle' is used in the implementation of our experiment. 

Fig. 2b shows the prediction along with the first three iterates Xa^n, n = l, 2, 3 com- 
puted via (ITOl) to (fT3l) . which approximate the exact geodesic 7^. Also plotted are four curves 
obtained in the very same way except that the term Sa{x, x) throughout is replaced by the term 
— 2|i;p no{x)p-^ ignoring the tangential component. These eight curves come in two groups of 
four curves each which within groups are almost identical. The lower quadruple consists of 
x+, Xa,i, and their counterparts computed with — 2|i;|^ no{x)p-^ instead of Sa{x, x); the upper 
quadruple consists of the respective second and third iterates. Similar results were found for all 
cases considered. 

4.1 Gaussian curvature 

In Section 13. 2[ we attached to each context a metric tensor G via the associated vector field. 
An intrinsic property of the geometry induced by G is the Gaussian curvature, K. This is a 
scalar quantity that describes how, and how strongly, the corresponding manifold (here M^) is 
deformed at each of its points |[23i . An approximation to K valid for our setting is 

K = 2a(t + 0{a^), where € = vi d2UJ - V2 diuj - io"^ (20) 

depends on the rotation of the respective vector field v in the first place. 

For contexts of type 1 and 2, € (hence K) turns out to vary across the manifold, and to 
assume positive as well as negative values. The geometry thus does not reduce to one of the 
classical non-Euclidean geometries (elliptic, hyperbolic, etc.) where K is constant. This is 
different with contexts of type 3: here (T can be shown to vanish identically, which implies a flat 
(essentially Euclidean) geometry. 

5 Experiment 

Our approach predicts the shape of the perceived distortion of the target as given by the expres- 
sion a introduced in Section [331 The magnitude of the distortion is determined by the parameter 
a, which has to be estimated empirically. For that purpose we carried out an illustrative experi- 
ment, using the method of compensatory measurement: a line distorted in the opposite direction 
is presented to the observer, who adjusts a until a straight line is perceived. The rationale for 
this procedure is clear: If r is (approximately) perceived as r + aa, then for small a, t — aa 
will (approximately) be perceived as r. 

The stimuli were constructed for six different contexts, as shown in Fig. 3. Each stimulus 
consisted of a sequence of 21 Encapsulated Postscript pictures ('frames'), displaying a constant 
array of context curves, drawn black on a white background, with superimposed curved lines 
of the form t — Uk o- {k = 1, . . . , 21), the a^s being equally spaced in the (sufficiently large) 
interval [—.11, .29]. The target r was always a horizontal straight line segment, drawn in red 
for easier visual identification. The 21 frames belonging to a single stimulus were combined to 

'in the experiment, only one line was shown at a time (together with the context). The ensuing perceptual bias 
may well be different from the one seen in Fig. 2a; and of course, it may differ between observers. 
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a) b) 




Figure 3: Six context patterns used in the reported experiment. Classification according to Section|4] a-c): type 1; 
d, e): type 2; f): type 3. Shiown are stimuli for a — 0,i. e., superimposed red lines are exactly straight lines. 

a single multipage PDF filel^ which was displayed on a LCD monitor watched binocularly from 
a distance of 100 cm. The observers' task was to scroll through the sequence of frames and to 
indicate that one where the red line appeared to them as most similar to a straight hne. Each 
trial thus resulted in an estimate a of the model parameter a. 

Nine observers participated in the experiment. Each participant was presented stimuli of six 
different classes (contexts), in a randomized order, and six trials were done with each stimulus 
classic The study thus yielded a total of 9 (observers) x 6 (contexts) x 6 (repetitions) = 324 
estimates of a. The complete data set is presented in Fig. 4. All a-estimates are positive, in 
accordance with the predicted direction of the distortion. Despite interindividual differences in 

*Two PDF files were prepared for each context, with the frames sequence in the 'forward' order ai , . . . , 021 , and 
in the 'backward' order 021, . . . , oi. These two versions were used alternately in each experimental session (see 
below). The case a = (exactly straight line) was never contained in the sequence. 

'Three of the six trials were run with the 'forward' and three with the 'backward' frames sequence to avoid 
possible directional bias in the observer's response. 
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am a #2 a #3 

0.3n 0.3-, 0.3n 




O.O-'-i 1 1 1 1 1— O.O-'-n 1 1 1 1 1— O.O-'-n 1 1 1 1 r 

abcdef abcdef abcdef 

c( #4 a #5 a #6 

0.3n 0.3n 0.3n 




O.O-'-I 1 1 1 1 1— CO-"-. 1 1 1 1 1— O-O-"-. 1 1 1 1 r 

abcdef abcdef abcdef 

a #7 a #8 a #9 

o.3n o.3n o.3n 




O.O-'-I — I — I — I — 1 — O.O-'-I — ; — I — 1 — I — O.O-'-I — 1 — I — ; — ■ — r 

abcdef abcdef abcdef 



Figure 4: Results of the experiment described in Section|5] Eacli of tlie nine panels displays the complete data set 
from an individual participant (36 trials). AbscissEe: context patterns labeled as in Figure 2; ordinates: estimates of 
a; cross marks: single-trial estimates; filled circles (connected): arithmetic means. 



susceptibility to the illusory effect, the pattern of the os (disregarding the average magnitude) is 
remarkably similar across subjects. 

For further analysis, we attempted to decompose the responses into an individual factor and 
a factor depending on the context^ Let a{i,c) denote the average a estimate across trials 
reported by observer #i for context #c. If the a{i,c) are proportional to the product of an 
individual factor, r]{i), times a context-dependent factor, k(c), then dividing these factors out 
renders the thus normalized responses a{i,c)/ (77(^)^(0)) = a{i,c) constant. In that (ideal) 
case one can argue that those two factors fully "explain" the (systematic) variation in the data. 
The goal thus is to find subject- and context-dependent factors reducing the variation in the 
a{i,c) as far as possible. 

A natural choice for r]{i) is the average of the a{i, c) across contexts, r]{i) = a{i, •). Suitable 
candidates for the factor k{c) could be various geometrical quantities related to, for example, 
the number and angles of the context-target intersections, or the curvature of the context lines. 

'"The strength-of-effect parameter a may reflect a variety of factors, including factors that depend on a. 
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Figure 5: Individual (grey, dotted lines) and group (black, solid line) response profiles, a) First step: responses 
a{i, c) normalized intra-individually; coefficient of variation = 0.48. b) Second step: profiles resulting from Step 1 
further divided by context-dependent factors k(c); coefficient of variation = 0.18. Details are provided in Section 5. 



The best among those considered wa 



J to 

where "best" means the following. Let individually normalized response profiles be defined as 
7r{i, c) = a{i, c)/r]{i), and let 7r(c) = 7r(-, c) denote their average across observers (considered 
as functions of c, each). The above k was best in the sense that division by this term maximally 
reduced the coefficient of variation, namely from CV = 0.48 for the profile ir{c) to CV = 0.18 
for the profile 7t{c)/k{c) additionally normalized by k{c). The individual profiles 7r(i, c) along 
with the group mean 7r(c) are shown in Fig. 5a. Similarly, Fig. 5b presents the respective profiles 
additionally normalized by context, 7r(f, c)/k(c) = a{i, c) and 7r(c)/K(c) = a{-, c). 




6 Discussion 

The present paper marks but one step in our approach to the study of visual field geometry. Ad- 
mittedly, the approach presented here has certain limitations. Some of these limitations follow 
naturally from our decision for a "phenomenological," i. e. purely descriptive theory of the GOI 
phenomena f33l, disregarding possibly underlying neurophysiological or neuropsychological 
mechanisms. Other limitations reflect the momentary state of development of the theory, and 
will hopefully be overcome at later stages: 

1. Modeling the context by a continuous vector field relies upon a convenient, yet unrealistic 
idealization; in reality, the context always consists of an array of finitely many distinct curves. 
To what extent this idealization is justifiable remains an open question]'^! 

"Noteworthily, k depends only on the component of a orthogonal to r, so that represents a kind of "energy" 
contained in the lateral deflection of the percept from the target. 

'"One might hope that a variable density of the target-context intersection points could be mimicked by admitting 
nonlinear parameterization of the context curves, e.g., by working with functions {u,9) i— >■ c{u,cj>{6)) where (j> 
depends nonlinearly on 6. It turns out, however, that the terms ixo{t), to(T), hence the shape of the distortion, are 
invariant under such reparameterizations. 
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2. Optical properties (color, background brightness, figure/background contrast, etc.) of the 
stimulus as well as its global geometric properties (relative size in the visual field, orientation 
w. r. t. gravicentric coordinates, etc.) have no representation in the present approach. One may 
expect that these properties do not affect the form but only the magnitude of the perceptual 
distortion, and can thus be accounted for by the "illusion strength" parameter a. Experimental 
studies must decide which parameters of the stimulus may enter the model via parameter a. 

3. The assumption of local interactions [Section |2j sub (a)] implies that "holistic" proper- 
ties of the context pattern (symmetry, presence or absence of "focal" points, etc.) are plainly 
ignored. While we feel that the global, "scenic" appearance of the context has been over- 
interpreted in some explanatory approaches, e. g. ll32l [141 l9l. we cannot a priori exclude that 
such holistic properties may play a modulating role. These aspects, as well as those mentioned 
above sub 2, call for more experimental research. 

4. The variational approach with fixed endpoints imposes a severe restriction on admissible 
percepts. For example, the present framework does not allow to treat the well-known Zollner 
illusion pOl, where the target lines are perceived as tilted, but preserve their straight line ap- 
pearance. Moreover, extension from straight lines to targets of simple geometric forms — e. g. 
distortions of circles to oval shapes in Hering-like contexts lITTl l28l — is certainly desirable. 
More generally, one may think of targets representing geodesies in some Riemannian basis ge- 
ometry that is perturbed by the context similarly as the Euclidean metric tensor / is perturbed 
by the term 2a v®v in 

A demarcation of our approach against so-called "field theories" of GOls [1 . pp. 167-170] 
appears necessary. In our approach, the vector field is a convenient mathematical representation 
of the context pattern. By contrast, some researchers think of a vector field induced in the neural 
substrate by the context part of the stimulus as a physical entity. This idea, originating in early 
theories of psychophysical isomorphism |[22l . inspired some modeling/explanatory approaches 
B |28] [T2j |25l that remained mostly on a qualitative or semi-quantitative level. 

Closer in spirit to the present approach is the work of Hoffman [ iT. TSl and Smith f3^ 
wherein, too, the"realist" concept of a (neuro)physical field was abandoned in favor of a purely 
formal, mathematical treatment. These developments based on vector fields and Lie derivatives 
represent a line of research parallel to ours: they, too, assume a local interactions and angular 
expansion hypothesis, and yield a prediction for the perceptual distortion of a form similar to 
ours. However, neither did these works make use of the calculus of variations for the derivation 
of the distortion, nor did they establish a connection with Riemannian geometry. 

A Riemannian geometry for visual perception was in fact derived by Zhang and Wu ll39l 
by elegant considerations of perceptual coherency of a visual object under rigid translations. 
Zhang and Wu build on the image intensity function and properties of motion detectors, and 
derive an affine connection depending on derivatives of the image function as the fundamental 
constituent of the geometry. Their concepts are not easily seen to be applicable to the present 
setting, however, which deals exclusively with static percepts. One difference concerns the 
Gaussian curvature, K, implied by the respective geometries. In [39] , K = always, making 
the geometry flat or pseudo-Euclidean, whereas in our approach K may assume positive and 
negative values across the manifold, and may also vanish identically, depending on the context; 
cf. Section |4~T] Furthermore, Zhang and Wu's geodesies are "perceptually straight," whereas 
ours are not, being the curved percept of a "physically straight" line. 
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Summarizing, we believe that our approach, in spite of its limitations discussed above, has 
its undisputable merits and potential for further developments: 

1. Approximate solutions to the variational proble introduced in Section [2] yield phe- 
nomenologically correct predictions for the perceptual distortion once the only free parameter 
of the model, a, has been determined (experimentally). This is evidenced by the fact that prop- 
erly counter-distorted targets appear, in a given context, as straight lines without perceivable 
residual distortion. A more thorough validation of the predicted shape of the distortion would 
certainly be desirable, but this is beyond the scope of the present work. 

2. The experimental data reported in Section [5] show a remarkable stability of the illusory 
effect across participants and context types. This finding supports the notion that GOls are 
not mere failures of the visual system, but that they reflect intrinsic principles of the structural 
organization of visual percepts [24 1. The method of the reported experiment can be used to 
study dependence of the "illusion strength" parameter a on various properties of the stimulus. 

3. Perhaps the most important feature of the mathematical model is its explicitly geometrical 
interpretation, which allows us to characterize the percept of a straight line as a geodesic in an 
appropriate, context-dependent Riemannian geometry (Section IJ!2l ). The analogy between the 
theory of a (world-)space metric, dependent on the mass distribution, and a possible theory of 
visual space metric, dependent on the perceptual content of the visual field, has been noticed 
by several authors ll35l [37l [34l . An important contribution here is the work of Zhang and 
Wu [39] who studied the perceptual coherence of a visual object under rigid motions. Here we 
demonstrate for the purely static case of geometric-optical illusions how the presence of context 
elements in the visual field perturbs its (initially Euclidean) geometry, as reflected by the metric 
tensor and how the illusory distortion naturally arises from the perturbed geometry. 
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'^Variational calculus is a widely used tool in vision science, computer vision (e.g., I13| [2l'). and elsewhere. Its 
use in, and specific application to, the current setting seem to be new, however. 
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Appendix 

Al. The Euler-Lagrange equations for problems VP and GP 

Proof of PropositionU} Using the notation introduced in Section[3]we calculate 

X 2a{x,v{x)) a{x,v{x))'^ . 

Vi-r = — H 7—, vix) — p5 x 

\x\ \x\ 

= p + 2a{p, v{x)) v{x) - a{p, v{x))'^ p, 
^ViF = {l-a{p,v{x))'^) p - 2a{p,v{x)) p ^^{p,v{x)) 

+ 2a vix) -7-(p, v{x)) + 2a(p, v{x)) v'(x)x 
at 

= v{x)f) p + 2a{p, v{x)) v'{x)x + 2a [v{x) - {p, v{x)) P] -^{P^ v{x)), 

\x\ 

so the general Euler-Lagrange equation Q assumes the form 

{l-a{p,v{x)f) p (21) 
= -2ai^[v{x)-{p,v{x))p] ^{p,v{x)) + {p,v{x)) [v {x)-v' (x)*] i|. 

Initially, (|2TI ) is a system of two nonlinear, second-order differential equations. However, 
both sides of (|2T]) are in fact orthogonal to p for all t S [toi^i]. meaning that the tangential 
component is trivial and only the component orthogonal to it matters. To see this, note that 

p = \x\~^x — \x\~^{x,x)x, whence {p,p) = 0; moreover, 

{v{x) - {p,v{x))p,p) = 

as well as 

{{v'{x) - v'ix)*) x,p) = \x\ {{v'{x)p,p) - {p,v'{x)p)) = 0. 
Thus effectively, the system (|2TI) reduces to one equation. Now 

p={p,p^)p^ (22) 

(since {p, p) = 0), so forming the inner product of (|2TI) with p^ we get the relevant part of the 
Euler-Lagrange equation (system), 

= {p,p^) {l-a{pMx)?)+2a{v{x),p^)j^{p,v{x)) 



+ 2a(p, v{x)) {(v'{x) - v'ixY) x, p^J 
{p, p^) (l - a {v{x),pf + 2a {v{x),p^f) 

+ 2a\x\ ({v{x), p^){v' {x)p, p) + {v{x), p) {diV2{x) - d2Vi{x))) , (23) 
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where the second equahty follows via (1221) from 

d 



^^(P>^(2;)> = {p,v{x)) + {p,v'{x)x) = {p,p-^){v{x),p-^) + \x\{v'{x)p,p) 



and 



^ ' ^ i ^ ^ dlV2{x) - d2Vl{x) ) \X2 

= {diV2{x) - d2Vi{x)) ( .^^ 

= {diV2{x)-d2Vi{x))\x\p^. (24) 

The form @ of the Euler-Lagrange equation then follows on dividing (|23] ) by the expression 
1 — a {v{x), p)"^ + 2a {v{x), p-^)"^ (which is strictly positive because a < 1) and rearranging. 

□ 

Proof of Proposition^ Let us first state the Euler-Lagrange equation for the modified func- 
tional X I-)- /^*^ {x{t), G{x{t)) x{t)) dt; it is 

= X + 2av^{x,v) + 2a {x,v) {v' - v'*)x. (25) 

(Here and in the following we suppress the argument x of f and v', for compactness of notation.) 
Forming the inner product with x gives 

= {x, x) + 2a {x, v) ^(2^) 'v) + 2a {x, v) {x, {v' — v'*) x) (26) 

Thus {x{t),G{x{t)) x{t)) is constant as a function of t, or a "first integral", with the conse- 
quence that the Euler-Lagrange equation for the modified functional amounts to the same as the 
Euler-Lagrange equation for the original functional x 1— Lg{x). Let us proceed with deriving 
the former equation. 

With ^(i, v) = {x, v) + {x, v'x) and (l24l) . equation (l25l) can be written as 

= Gx + 2a (x, v'x) v + 2a \x\ (x, v) {diV2 — d2Vi) p"*", (27) 

where again 

G = I + 2av ® V, with inverse G^^ = I — v ® v. 

1 + 2a 

Hence 

G-^v = v/{l + 2a), G- = P^- {v, p^) v, 

1 + 2a 
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so on writing v = {v, p)p+ {v, p^)p-^ and recalling the notation a; = (9it;2 — c^2't^i> we can state 
(|27] ) as a differential equation in explicit form, 



;,|2 



l + 2a 



{p,v'p) [{v,p)p+{v,p )p- 
+ {v, p) u {p^{l + 2a) - 2a {v, /) {{v, p)p + {v, 



[{P, v'p) {v, p) -2auj {v, pf {v, p-^)j p 
+ ((p, v'p) {v, p^) + 00 {v, p) {1 + 2a {v, pf }) p' 



l + 2a 



The proof of Proposition |2] is complete. 



(28) 



□ 



A2. Approximations 

Proof of Proposition \3\ Equation (|7]l can be written as a first-order differential equation by 
means of the common recipe of enlarging the "state space," from curves x to pairs of curves 
X, X. The iteration (fTTI) . (fT2l) then becomes the well-known Picard-Lindelof scheme, except 
that here we do not have an initial value problem for x,x; rather, the two endpoints of x are 
fixed. There is only one obstacle for a straightforward application of the classical proof: one 
needs an a priori estimate for the distance of the iterates from the target, which has to remain 
bounded. Once this is achieved, it is a standard exercise to establish the boundedness and 
Lipschitz conditions necessary for an application of the Banach fixed point theorem. 
We leave that aside and concentrate on the a priori estimate. Let 

Ja,n — / |io,n('U')| du, 
Jto 

and suppose initially that sup^ = M < oo, the norm being declared as \\A\\ = 

J2j k l^i.fcl for matrices A = (aj^k)- Putting po = (ti — to)/£ we have by ([TTI) and (fTSl ) 

= {l/T) po + aUa{Xa,n ) (29) 

where 

rt rti ,t 

Ua{x,x){t) = / Sa{x, x){u) du — — / / Sa{x, x){u) du dt. 
J to J tl) J to 

From the straightforward bound 

\Sa{x,x)\ <6\x\'^\\v'{x)\\ (30) 

one readily gets the estimate 

II Ua(Xa^m i(y^n) ||oo ^ 12A^t/Q,^^. (31) 
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Thus by 



J, 



a,n+l 



to 



(e/Tf + 2a{i/T) {po ,U^ix,x)it))+a^\Ua{x,±m\' 



dt 



= f/T [l + al2MJ^^nT/if, 

or with Ka,n+i = Ja,n+i T/f and Aa = al2Me, 

Ka,n+i < (1 + al2MK^^n{iVT) T/if = (1 + A^K^^nf . 

Since Jafi = f^^ du = £^/T, the starting value is K^fl = 1. 

We therefore have to study a "sub-recursion" of the form 

Xn+l<<f{Xn), ^{x) = {l + axf, Xq = I, 

where a is a positive constant. For a < 1/4 the function Lp has two fixed points, 

z±{a) = (1 - 2a ± Vl - 4a) /(2a^). 

As a I the smaller fixed point remains bounded; in fact, 1 < 2;-(a) < 4 for all a G [0, 1/4]. 
We now proceed by induction. We have x„ < Z-{a) for n = 0, so suppose this holds for 
some n > 0. Then '^{xn) < <f{z-{a)) by the monotonicity of tp, and hence Xn+i < ^{xn) < 
ip{z^{a)) = z^{a), as claimed. 

The conclusion for our initial problem is that if we choose a* < {ASMiy^ then 

SUPn>0,a<a* Ja,n < U^/T. (32) 

As a consequence one has by (l29l ) and (|3TI ) the uniform bound 

||xa,n+i||oo <l/T + aA^Ml^/T = l/T{l + aA^Ml) < 2£/T; (33) 
moreover, differentiating ( [291 ) and using (l30l) and (1331 ) gives 

||a5a,n+l||oo = Ct\\Sa{Xa,n,Xa,n)\\oo < a2AM {l/Xf , 

whence 

rti 

/ |x«,„+i(u)| du < a2AMf/T < i/{2T) (34) 
Jto 

(for every n > and a < a*). The required a priori estimates are now obtained from (l34l ) by 
setting y = T, X = Xa,n in the following lemma, the easy proof of which is omitted. 

Lemma 1 Suppose x, y ^ X are such that f^^ \x{u) — y{u) \ du < B. Then 

\\x — y\\oo 1^ '^BT and \\x — y\\oo < 2B . 
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Indeed, since f = we may set B = a 24M£^/T and conclude that 



X. 



a,n 



rlloo < a48M£2 < ||xa,n - r||oo < a48M^V^ < ^/^ (35) 



forn > 1 , a < a* . These estimates were derived under the assumption that 1 1 f ' (C) 1 1 is globally 

bounded. However, by (l35l) and because a* may be arbitrarily small, it suffices that 

locally bounded in the vicinity of r, which it is. This concludes the crucial part of the proof. □ 

Proof of Proposition |?] By definition we have [5o(t, f) — (r, f)], whence it 

readily follows that 

/ \xa{u) — Xa,i{u)\du = 0{a^) 
Jto 

(as a — 0). Therefore \\xa — Xa,i\\oo = O(a^), by Lemma[T] so applying (fT4l) with n = 1 
completes the proof of (fTTl ). 

As for the second assertion, let us consider curves ya ^ X with shape r] (i.e., of the form 
ya = T + ar] + 0{a^)). Let pa = Py^ = ya/\ya\- Straightforward expansions give 

Pa = po + a{T/e){ri, Po)pq + 0{a^), 
Pa = a{T/i){f,,p^)p^ + 0{a^). 

The approximation 

pi = pi- a(r/^)(r?, p^)po + 0{a^) 
is readily verified on noting that — a(T/£){ri, Pq)po\'^ = 1 + O(a^) and 



^Po + aiT/i){i),p^)p^, p^-a{T/i){i),p^)poj=0{a'). 

Thus for curves ya with shape rj one has 

(p„,/5^) = a(T/^)(f?,pf^) + 0(a2). (36) 

On the other hand, since ya = t + 0(a) as a — > 0, hence \ya\ = (-/T + 0(q), the right-hand 
side of dill evaluated at ya behaves as 

-2a {t/T) [{v{t), p^){po,v'{t)p^) + {v{t), po) Lo{T)]+0{a^) = -2a {£/T) no{T) + 0{a^). 

The comparison with (l36l ) shows that ya satisfies the Euler-Lagrange equation (|4]| with second- 
order accuracy if and only if 

{v,p^) = -2{e/Tfno{T). 

By ([T6l ). this condition is equivalent to {i], p^) = {a, Pq), and hence, by the boundary condi- 
tions, also equivalent to {rj, p^) = {a, Pq). □ 
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A3. Context representations 

Consider two functions c and as introduced in Section |4l along with the family of context 
curves u — )• C0{u) = (u, c{u, 6)) parameterized by 0. The tangent direction of such a curve at 
the point Ce{u) is given by the unit vector 

v{Ce{u)) - 



Vl + (5ic(u,0))2 

Since by assumpton there exists for every ^ = (^1,^2) in some planar region E a parameter 
9 = '!9(Ci,C2) such that c(.^i, ^2)) = ^2. the points Cg{u) = {u,c{u,9)) fill the region H 
and we get a vector field f on H by setting 

\/l + (8ic(6.tf(&.6))P 

Toward calculating the Jacobian of v note first that because of ^2 = ^2)) we have 

1 = J- ^2 = 92C • 82^, = J- 6 = 5iC + d2C ■ 

hence 

020 620 

where here and below it is understood that dk'& and dkC are evaluated at the arguments .^1,6 
and ii,'d{ii,i2), respectively. Similarly, 



d r, _ o2 „ , o2 „ o „q _ o2 „ Ffl „ ^iC ^ a „ _ a2 „ a „(, _ ^12 



■ dic = diic + di2C ■ c?!"!? = diic — di2C ■ — — , — — dic = di2C ■ 82'^ 



c 



With p = 1 + (9ic)^ the two components of v can be written as vi = p~^/^, V2 = p~^/^ 8ic, 
respectively. We have 



81V1 



%-V2 = _p-3/2 



a ^-1/2 ^-3/2 o2 

06 C^2C 



furthermore 



81V2 = p 


-1/2 1 




- 


= p 


-3/2 1 




-8f,c 



and similarly 



92^2 = P-'/' 1^ 

a2C 
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The Jacobian of the vector field (|37] ) thus is 



^11 ^12^ • 



12'- 

d2C d2C 



and its rotation is 



iO = P"'/' die (39) 

(with the convention that all those partial derivatives are evaluated at ^i, ^2))- 

Given a planar curve x with associated 2-gon p, p-^, one readily derives explicit expressions 
for the crucial quantitites ta(x), na{x) from (l38l) and ( [39l ). For example, if as in Section |4] 
we take x = t where r(t) = (t, 0), t G [— ^/2,^/2], the 2-gon is constant along r, with 
p = (1, 0), p-*- = (0, 1), and we get for a = 



to(r) 
"o(r) 

The latter expression gives ([18 



(1 + (aic)2)2 



81 c 
92 C 



(1 + {dicyf 



A4. Gaussian curvature 

Derivation of the approximation d20D f/ze Gaussian curvature. It is a consequence of Gauss's 
theorema egregium that the Gaussian curvature of the Riemannian geometry induced by the 
metric tensor G can be expressed in terms of G itself ||23]| . A formula convenient for our purpose 
is EE p. 114] 



K 



2V^ 



d2E - diF 
7^ 



diG - d2F 



V9 



1 



E diE d2E 
F diF d2F 
G diG d2G 



Here we have switched to the classical notation 



E = gii = l+2avj, F = gu = §21 = 2aviV2, G = 522 = l+2afi, 9 = 911922- 



(40) 



-5?2> 



thereby accepting a change in the meaning of the symbol G, which will not cause confusion. 
Now 5 = 1 + 2a is constant (since \ \v\\ = 1). Therefore, ^ times the term in curly brackets 
on the right-hand side of (l40l) is equal to 

d^22E + dl^G - 2dl2F = 2a {^laf? + dl^vl - 2dl2{viV2)] 

= Aa{{d2Vi)'^ + Vidl2Vl + {dlV2f + V2dfiV2 - (9lfl 921^2 - WlC?l2^^2 - 9if292fl - V2df2Vl} 

= 4a {(5iV2 - d2Vi)'^ + 5iW2(?2Wi - 51^152^2 + V2 di{diV2 - d2Vi) - vi d2{diV2 - d2Vi)] 

= 4a {w^ - Vi d20J + V2 diUJ - (9iVi92U2 - 9iW2(92Wl)} , 
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a) b) 




Figure 6: Gaussian curvature of the Riemannian manifold associated with the respective context. Regions with 
(approximately) positive or negative curvature (£ > or £ < 0) are marked red and blue, respectively. Labels a) to 
e) refer to the same contexts as shown in Fig. 3. For details see Section|4T| 

with uj the rotation of v. The last term in brackets, 9i 11152^2 — (?iU252i^i, equals the determinant 
of the Jacobian matrix v' . This determinant vanishes because v' is rank-deficient due to the 
constraint v\ + = 1- (This can be seen also from (|38]).) The determinant in the last term of 
(l40l ) is of the order O(a^). Therefore, putting everything together one finds that 

K = ~ 2(i^2a) ~ ^'^^ ^ ^^^^ ~^ O(a^) 
= 2a (fi d20J — V2 diui — o;^) + O(q^), 

which is (go]). □ 
Explicit expressions for the quantity € = vi d2UJ — V2 diuj — uP' can be derived from ( [39b 
for each of the three context types. In Fig. 6, parts of the respective context are color-marked 
depending on the sign of C The vertical stripes in the panels a and c reflect the independence of 
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£ on its second argument for contexts of type 1 : C = (^(^i) in this case. Such simplification does 
not occur with type 2 contexts (panels d, e). By contrast, € = everywhere for contexts of type 
3 (not shown). This could be verified using (l39l ) and the particular- form of the function c in this 
case. It is more illuminating to recall that the context curves are (segments of) concentric circles, 
which by translation invariance can be assumed to be centered at the origin. The corresponding 
vector field then is v (^) = (^2, -Ci)/V^'i + ^h from which C = easily follows. 

References 

[1] Akhiezer, N. I. (1962). The calculus of variations. New York: Blaisdell. 

[2] Ambrosio, L. & Masnou, S. (2003). A direct variational approach to a problem arising in image 
reconstruction. Interfaces and Free Boundaries, 5, 63-81. 

[3] Bekesy, G. von (1967). Sensory inhibition. Princeton: Princeton University Press. 

[4] Berliner, A. & Berliner, S. (1948). The distortion of straight and curved lines in geometric fields. 

American Journal of Psychology, 61, 153-166. 

[5] Brown, J.F. & Voth, A. C. (1937). The path of seen movement as a function of the vector field. 
American Journal of Psychology, 49, 543-563. 

[6] Carpenter, R. H. S. & Blakemore, C. (1973). Interactions between orientations in human vision. 
Experimental Brain Research, 18, 287-303. 

[7] Coren, S. & Girgus, J. S. (1978). Seeing is deceiving: the psychology of visual illusions. Hills- 
dale (NJ): Lawrence Erlbaum. 

[8] Dacorogna, B. (2004). Introduction to the calculus of variations . London: Imperial College Press. 

[9] Day, R. H. (1972). Visual spatial illusions: a general explanation. Science, 175, 1335-1340. 

[10] Ehm, W. (201 1). A variational approach to geometric-optical illusions modeling. In D. Algom et 
al. (Eds.), Fechner Day 2011 (pp. 41^6). Ra'anana: International Society for Psychophysics. 

[11] Ehrenstein, W. (1925). Versuche iiber die Beziehungen zwischen Bewegungs- und Gestalt- 
wahrnehmung. Zeitschrift fur Psychologic, 96, 305-352. 

[12] Eriksson, E. S. (1970). A field theory of visual illusions. British Journal of Psychology, 61, 451- 
466. 

[13] Foster, D. H. (1978). Visual apparent motion and the calculus of variations. In E. L. J. Leeuwenberg 
& H. F. J. M. Buffart, Eds. (Eds.), Formal Theories of Visual Perception (pp. 67-82). Chichester: 
Wiley. 

[14] Gregory, R. L. (1963). Distortion of visual space as inappropriate constancy scaling. Nature, 199, 
678-680. 

[15] Helmholtz, H. (1867). Handbuch der Physiologischen Optik (Vols. 1-3). Leipzig: Voss. 

[16] Bering, E. (1861). Beitrdge zur Physiologic I: Vom Ortsinne der Netzhaut. Leipzig: Engelmann. 

[17] Hoffman, W. C. (1966). The Lie algebra of visual perception. Journal of Mathematical Psychology, 
3, 65-98. 

[18] Hoffman, W. C. (1971). Visual illusions of angle as an application of Lie ttansformation groups. 
SIAM Review, 13, 169-184. 

[19] Horrell, R. I. (1971). The angle of intersection of contours as the determinant of a geometric illu- 
sion. Perception & Psychophysics, 10, 208-210. 



25 



[20] Hotopf, W.H.N. & Ollerearnshaw, C. (1972). The regression to right angles tendency and the 
Poggendorf illusion 1, 11. British Journal of Psychology, 63, 359-367 and 369-379. 

[21] Hotopf, W. H. N. & Robertson, S. H. (1975). The regression to right angles tendency, lateral inhi- 
bition, and the transversals in the Zollner and Poggendorf illusions. Perception & Psychophysics, 
18, 453-459. 

[22] Kohler, W. (1920). Die physischen Gestalten in Ruhe und im stationaren Zustand. Braunschweig: 

Vieweg. 

[23] Laugwitz, D. (1965). Differential and Riemannian geometry. New York: Academic Press. 
[24] Metzger, W. (1975). Gesetze des Sehens. Frankfurt: Kramer. 

[25] Motokawa, K. (1970). Physiology of color and pattern vision (Chapter 9). Tokyo: Igaku Shoin. 

[26] Oppel, J.J. (1855). Uber geometrisch-optische Tauschungen. Jahresbericht des physikalischen 
Vereins zu Frankfurt am Main, 1854/55, 31-41. 

[27] Oppel, J. J. (1861). Uber geometrisch-optische Tauschungen (Zweite Nachlese). Jahresbericht des 

physikalischen Vereins zu Frankfurt am Main, 1860/61, 26-31. 

[28] Orbison, W. D. (1939). Shape as a function of the vector-field. American Journal of Psychology, 
52,31-45. 

[29] Robinson, J. O. (1998). The psychology of visual illusion (2nd ed.). Mineola (NY): Dover. 

[30] Smith, D. A. (1978). A descriptive model for perception of optical illusions. Journal of Mathemat- 
ical Psychology, 17, 64-85. 

[31] Struik, D. J. (1961). Lectures on classical differential geometry, IndEd. Reading: Addison- Wesley. 

[32] Tausch, R. (1954). Optische Tauschungen als artifizieUe Effekte der Gestaltungsprozesse von 
GroBen- und Formenkonstanz in der natiirlichen Raumwahmemung. Psychologische Forschung, 
24, 299-348. 

[33] Wackermann, J. (2010). Geometric-optical illusions: a pedestrian's view of the phenomenal land- 
scape. In A. BastianeUi & G. Vidotto (Eds.), Fechner Day 2010 (pp. 171-176). Padova: Interna- 
tional Society for Psychophysics. 

[34] Wackermann, J. & Kastner, K. (2009). Paradoxical form of filled/empty optical illusion. Acta Neu- 
robiologiae Experimentalis, 69, 560-563. 

[35] Wagner, M. (2006). The geometries of visual space. Mahwah: Lawrence Erlbaum. 

[36] Walker, E. H. (1973). A mathematical theory of optical illusions and figural aftereffects. Perception 
& Psychophysics, 13, 467^86. 

[37] Westheimer, G. (2008). Illusions in the spatial sense of the eye: Geometrical-optical illusions and 
the neural representation of space. Vision Research, 48, 2128-2142. 

[38] Wundt, W. (1898). Die geometrisch-optischen Tauschungen. Abhandlungen der mathematisch- 
physischen Classe derKonigl. Sdchsischen Gesellschaft der Wissenschaften, 24, 55-178. 

[39] Zhang, J. & Wu, S. (1990). Structure of visual perception. Proceedings of the National Academy 

of Sciences USA, 87, 7819-7823. 

[40] Zollner, F. (1860). Uber eine neue Art von Pseudoskopie. Annalen der Physik und Chemie, 186, 
500-523. 



26 



